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Abstract. We introduce and study a 2-parameter family of unitarily invariant 
probability measures on the space of infinite Hermitian matrices. We show that 
the decomposition of a measure from this family on ergodic components is described 
by a determinantal point process on the real line. The correlation kernel for this 
process is explicitly computed. 

At certain values of parameters the kernel turns into the well— known sine kernel 
which describes the local correlation in Circular and Gaussian Unitary Ensembles. 
Thus, the random point configuration of the sine process is interpreted as the ran- 
dom set of "eigenvalues" of infinite Hermitian matrices distributed according to the 
corresponding measure. 

Contents 

Introduction 

1. The pseudo-Jacobi ensemble 

2. The scaling limit of the correlation functions 

3. The Hua-Pickrell measures 

4. Ergodic measures 

5. Approximation of spectral measures 

6. The main result 

7. Vanishing of the parameter 72 

8. Remarks and problems 

9. Appendix: Existence and uniqueness of decomposition on 
ergodic components 

References 



Introduction 

We first introduce some basic notions, and then describe the main results of the 
paper. 

Random point configurations and correlation functions. Let 3Ebea locally 
compact space. A locally finite point configuration in X is a finite or countably 
infinite collection of points in X, also called particles, such that any compact set 
contains finitely many particles. The ordering of the particles is unessential. For 
the sake of brevity, we will omit the adjective 'locally finite'. A point process on X is 
a probability measure on the space Conf(X) of point configurations. Given a point 
process, we can speak about the random point configuration. The nth correlation 



measure of a point process (n = 1, 2, . . . ) is a symmetric measure p n on £ n , which 
is determined by the relation 

(p n ,F)=E(j]F(a;i,...,x n )), (0.1) 

where F is a compactly supported test function on £ n , E is the symbol of expecta- 
tion, and the summation is taken over all ordered n-tuples of particles chosen from 
the random point configuration. The nth correlation function is the density of p n 
with respect to the nth power of a certain reference measure on X. Usually, the 
reference measure is the Lebesgue measure. The first correlation function is also 
called the density function. See [Len], [DVJ, Ch. 5] 1 , [So]. 

The Dyson circular unitary ensemble. Let T C C be the unit circle and 
T N /S(N) be the set of orbits of the symmetric group S(N) of degree iV acting on 

the torus T^, where N = 1, 2, Consider the following probability measure on 

T N /S(N): 

N 

const • J[ \uj - u k \ 2 Yl d<pj, Uj = e 2nt ^ G T, e [-§, ±], (0.2) 

l<j<k<N j=l 

where const is the normalizing factor, i = This measure defines a point 

process on X = T living on the iV-point configurations, which is called the iVth 
Dyson circular unitary ensemble or simply the Dyson ensemble for short. Note 
that the Dyson ensemble is invariant under rotations of T. 

Let U(N) be the group of iV x N unitary matrices. Consider the natural pro- 
jection U(N) — > T N /S(N) assigning to a matrix U G U(N) the collection of its 
eigenvalues. Note that the fibers of this projection are exactly the conjugacy classes 
of the group U(N). The measure (0.2) coincides with the pushforward of the nor- 
malized Haar measure on U(N) under this projection. In other terms, (0.2) is the 
radial part of the Haar measure. It follows that the Dyson ensemble is formed by 
spectra of random unitary matrices U G U(N) distributed according to the Haar 
measure. See [Dys], [Me]. 

The sine process. This is a translationally invariant point process on I = M. Its 
correlation functions (with respect to the Lebesgue measure on R) are given by 

n 

n = l,2, yi,...,y n G R. 

j,k=l 

(0.3) 

The function sin( 7 (y ^ on R x R is called the sine kernel. 

n(y-y') 

The correlation functions of the sine process can be obtained from the correlation 
functions of the iVth Dyson ensemble by the following scaling limit as iV — > oo. Fix 
an arbitrary point no G T and rescale the angular coordinate cp about the point no 
by writing n = n e 27 " y//Ar . Then, for any fixed n, the nth correlation function of the 
iVth Dyson ensemble, expressed in terms of the y-variables, converges, as iV — > oo, 
to the function (0.3). See [Dys], [Me]. 



Pn{yi,---,y n ) = det 



sin(7r(yj - y k )) 



1 In the book [DVJ] the correlation measures are called the "factorial moment measures". 
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A substitute of the Haar measure. A natural question is whether the sine 
process can be interpreted as a radial part of an infinite-dimensional analog of the 
Haar measure. In this paper we suggest such an interpretation. 

It is convenient to pass from unitary matrices to Hermitian matrices. Let H(N) 
be the linear space of N x N complex Hermitian matrices. Consider the Cayley 
transform 

H(N)3X~U= l -^eU(N), N = l,2,... (0.4) 
i + X 

The map (0.4) is one-to-one, and the complement of its image in U(N) is a negli- 
gible set. Thus, we can transfer the normalized Haar measure from U(N) to H(N). 
The result has the following form 

const • det(l + X 2 )~ N x (the Lebesgue measure). (0.5) 

Let H be the space of all infinite Hermitian matrices X = [Xjk]j°k=i- ^ re ~ 
markable fact is that the measures (0.5) with different values of N are consistent 
with natural projections H(N) — > H(N — 1) and, therefore, determine a probability 
measure m on H. We view m as a substitute of the Haar measure on U(N) for 
N = oo. 

Ergodic measures. Assume that we have a group acting on a Borel space. An 
invariant probability Borel measure is called ergodic if any invariant mod set has 
measure or 1. Ergodic measures coincide with extreme points of the convex set 
of all invariant probability measures, see [Ph]. For continuous actions of compact 
groups ergodic measures are exactly orbital measures, i.e., invariant probability 
measures supported by orbits. According to the general philosophy of the ergodic 
theory, the concept of ergodic measure is a right generalization of that of orbital 
measure. 

We are interested in a special situation when the space is H and the group is 
an infinite-dimensional version U(oo) of the groups U(N). By definition, U(oo) is 
the union of the groups U(N). Its elements are infinite unitary matrices \Ujk]fk=i 
with finitely many entries Ujk not equal to Sjk- The group U (oo) acts on the space 
H by conjugations. 

Consider the space f2 whose elements u> are given by 2 infinite sequences 

oo oo 

ocf > at > ' ' ' > 0» aj~ > ct:^ > • • • > 0, where ^(a+) 2 + ^(a~) 2 < oo, 

J=l 3=1 

(0.6) 

and 2 extra real parameters 71, 72, where 72 > 0. 

It is known that the ergodic measures on H can be parametrized by the points 
w£fl. We consider O as a substitute of the space T N /S(N) for N = 00. 

Let us explain the asymptotic meaning of the parameters 0^,71,72. According 
to a general result, each ergodic measure M on H can be approximated by a 
sequence {MW I N = 1,2,...}, where AfW is an orbital measure on H(N) 
with respect to the action of U(N) by conjugations. Any such measure M^ N > is 
specified by a collection of eigenvalues. Then the parameters of 00 describe the 
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asymptotic behavior of A^ as N — > oo: 



+ K) 2 + (a 2 ) 2 + .... 

(0.7) 

For more detail, see [Pi2], [OV], and references therein. 

From spectral measures to point processes. It can be proved that any U(oo)- 
invariant probability measure on H can be decomposed on ergodic components. 
I.e., it can be written as a continual convex combination of ergodic measures. This 
decomposition is unique, we call it the spectral decomposition. It is determined by a 
probability measure on O, which we call the spectral measure of the initial invariant 
measure. 

We map the space O to the space Conf(R*) of point configurations on the punc- 
tured real line R* = R \ {0} as follows: 

O 3 u = ({«+}, {«"}, 71, 72) - C = (-ar, -« 2 ", . . . , a+ a+) G Conf (R*), (0.8) 

where we omit possible zeros among the numbers af. The map (0.8) transforms 
any spectral measure (which is a probability measure on O) to a point process on 
R* . This makes it possible to describe spectral measures in terms of the correlation 
functions. However, the map (0.8) ignores the parameters 71,72. 

Note that each configuration C G Conf(R*) of the form (0.8) is contained in a 
sufficiently large interval \x\ < const. It follows that C _1 (the image of C under 
the inversion map x 1— > l/x) is a well-defined configuration on the whole line R. 

An interpretation of the sine process. Applying the procedure described 
above to the measure m on H we prove the following result. 

Theorem I. Let P be the spectral measure of the U "(00) -invariant measure m and 
let V be the corresponding point process on R* . Then the point process on R obtained 
from V under the transform x 1— > y = — ^ coincides with the sine process. 

A lucid explanation of this result follows from the comparison of two approxi- 
mation procedures: that for the correlation functions of the sine process and that 
for the ergodic measures. Indeed, the eigenvalues in (0.7) grow linearly in N, so 
that we rescale them according to the rule A = Nx. Under the Cayley transform 
u = the scaling takes the form 

j_ Nx 2i_ /j_\ = ( _ l)e 2niy/N Q ( J_\ = _ J_ 

U i + Nx + Nx + \N2J [ )€ +U \Ny' V nx' 

(0.9) 

which means that the variable y is consistent with the scaling of the Dyson ensemble 
near the point uq = — 1. 

Thus, the statement of Theorem I is not surprising. However, the justification 
of the formal limit transition made on the level of correlation functions requires 
certain efforts. 
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A^ + 
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72 + K) 2 + (a+) 2 + 



Note also that dividing the eigenvalues A G K by N corresponds in terms of 
u = to the fractional-linear transformation of T of the form 

(N + l)u+(N-l) 
U ^ (N-l)u+(N+l)- ( °- 10) 

This transformation has two fixed points, +1 and —1. Near the point —1 it looks as 
the expansion by the factor of N while near the point +1 it looks as the contraction 
by the factor of N. Using (0.10) as a scaling transformation one can define a scaling 
limit for the correlation functions of the Dyson ensembles staying on the circle T. 
Theorem I is complemented by 

Theorem II. The spectral measure P of the measure m is concentrated on the 
subset {uj G O | 72 = 0}. 

Thus, the parameter 72 (which is ignored by the map (0.8)) is actually irrelevant 
for the measure m. In a certain sense, this means that the measure m does not 
involve Gaussian components (see §4 about the connection of the parameter 72 with 
Gaussian measures). 

A generalization: the main result. Let s G C, > — \ be a parameter. 
Consider the following probability measure on T N /S(N): 

N 

const- |j \uj — Uk\ 2 J^[(l + %) s (l + Uj) s dipj, 

l<j<k<N j = i (0-11) 

Uj = e 2 ^eT, ^e[-|,i]. 

When s = 0, we get (0.2). Thus, this is a deformation of the measure (0.2) depend- 
ing on two real parameters, and Ss. The measure (0.11) is the radial part of 
the probability measure on U(N) of the form 

const • det((l + U) 5 ) det((l + U' 1 ) 3 ) x (the Haar measure on U(N)). (0.12) 

Transferring the measure (0.12) from the group U(N) to the space H(N) by means 
of the Cayley transform (0.4) we get the following measure on H(N), which is a 
deformation of the measure (0.5): 

const • det((l + iX)- s ~ N ) det((l - iX)- s ~ N ) x (the Lebesgue measure on H(N)). 

(0.13) 

When s is real, the expression (0.13) takes a simpler form: 



-s-N 

s£l, s > - 



const • det((l + X ) s ) x (the Lebesgue measure on H(N)), ^ 

2 • 



Again, it turns out that the measures (0.13) are consistent with the projections 
H(N) — > H(N — 1) and determine a £/"(oo)-invariant probability measure on the 
space H. We denote it by m^ s \ Note that = m. 

To our knowledge, the finite-dimensional measures (0.14) were first studied by 
Hua. He calculated the normalizing constant factor in (0.14) by a recurrence in N, 
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and his argument proves the consistence property (although he did not state it ex- 
plicitly), see [Hua, Theorem 2.1.5]. Much later Pickrell [Pil] considered analogs of 
the measures (0.12) and (0.13) (with real s), which live on complex Grassmannians 
and on the spaces of all complex matrices, respectively. He proved the consistence 
property and considered the analogs of the measures rw- s > on the space of all com- 
plex matrices of infinite order. His paper also contains a few other important ideas 
and results. Apparently, Pickrell was unaware about Hua's work. Note also Shimo- 
mura's paper [Shim], where an analog of the measure m^ -* for the infinite orthogonal 
group was constructed (more general measures depending on a parameter are not 
discussed in [Shim]). The possibility of introducing a complex parameter (in the 
case of Hermitian matrices) was discovered by Neretin [Ner2]. He also examined 
further generalizations of the measures m^ s \ 

We propose to call the measures the Hua-Pickrell measures. 

Theorem III. The Hua-Pickrell measures on H are pairwise disjoint. I.e., 
for any two different values s' , s" of the parameter there exist two disjoint Borel 
subsets in H supporting m^ s -* and m^ s \ respectively. 

The next claim is the main result of the paper. 

Theorem IV. Let P^ be the spectral measure of a Hua-Pickrell measure . 
The corresponding point process on M* can be described in terms of its corre- 
lation functions. They have the determinantal form 

pi l 8 \x 1 ,...,x n ) = det[K( s \x j ,x k )]l k = 1 , (0.15) 

where x') is a certain kernel on R* x M* which can be expressed through 

the confluent hyper geometric function or, for real values of s, through the Bessel 
function. 

See Theorem 2.1 below for explicit expressions for the kernel. As in Theorem I, 
one can use the transformation C h- > C -1 to pass from R* to R. 

Pseudo— Jacobi polynomials. The proof of Theorem IV, as that of Theorem 
I, goes in three steps: the calculation of the correlation functions for the finite- 
dimensional measures (0.13), the scaling limit transition as N — > oo, and a justifi- 
cation. However, the first step, as compared with the case of the Dyson ensemble, 
is more involved. We show that the correlation functions are expressed through the 
Christoffel-Darboux kernel for the so-called pseudo-Jacobi polynomials. This fam- 
ily of orthogonal polynomials, which is not widely known, has interesting features. 
It is defined by a weight function on M. possessing only finitely many moments, so 
that the system of orthogonal polynomials is finite. 

Organization of the paper. In §1 we introduce the pseudo-Jacobi ensemble and 
obtain its correlation functions. In §2 we compute the scaling limit of these corre- 
lation functions as the number of particles goes to infinity. The limit correlation 
functions are given by a determinantal formula and we write down the correlation 
kernel explicitly. In §3 we define the Hua-Pickrell measures and show that 
they are pairwise disjoint. §4 provides a brief summary of known results about 
the ergodic U(oo) -invariant probability measures on H. In §5 we show that the 
spectral measure for any U(oo) -invariant probability measure M on H can be ap- 
proximated by finite-dimensional projections of M. §6 contains the proof of our 
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main result (Theorem IV above). In §7 we prove that the sine process has no 
Gaussian component (Theorem II above). §8 contains remarks concerning the con- 
nections of our work with other subjects as well as several open problems. §9 is 
an appendix where we prove the existence and uniqueness of the decomposition of 
[/(oo)-invariant probability measures on H on ergodic measures. 

Acknowledgment. At various stages of the work we discussed the subject with 
Sergei Kerov, Yuri Neretin, and Anatoly Vershik. We are grateful to them for valu- 
able remarks. The second author (G. O.) was supported by the Russian Foundation 
for Basic Research, grant 98-01-00303. 

1. The pseudo-Jacobi ensemble 

In this section we define the pseudo-Jacobi ensemble and compute its correlation 
functions. 

Consider the radial part of the Haar measure on U(N) which determines the 
Dyson ensemble, see (0.2). Under the inverse Cayley transform T — > R which takes 
u E T to x = i ^ the measure (0.2) turns into the following measure on 
R N /S(N) = ConfTv(M), the set of Appoint configurations on R: 

N 

const J] (xj - x k f ■ JJ(1 + x))~ N dxj . (1.1) 

l<j<k<N j=l 

More generally, let s be a complex parameter. We introduce the following defor- 
mation of the measure (1.1) depending on s: 

N 

const [[ (xj - x k ) 2 ■ JJ(1 + iXj)~ s ~ N (l - iXj)~ s ~ N dxj 

l<j<k<N j=l 

= const JJ(1 + x^-^-^e 295 Ar ^ 1+ix ^d Xj . 
i=i 

Here we assume that the function Arg(. . . ) takes values in (— 7r, n) (actually, Arg(l + 
ixj)e {-**)). 

Proposition 1.1. The measure (1.2) is finite provided that > — \. 
Proof. This follows from the estimate 

(1 + x 2yXs-N e 2QsA rg (l+i X ) x | a .|-2»-2JV j x G M, |x| » 0, (1.3) 

and the fact that the expansion of rii<j<A;<Ar( a; j — x k) 2 involves only monomials 
of degree less or equal to 2A — 2 in each variable. □ 

Henceforth we assume the condition > — \ to be satisfied, and we choose the 
normalizing constant in (1.2) in such a way that (1.2) defines a probability measure. 
About the case 9fe < — \ see §8 below. 

Note that (1.2) corresponds, via the Cayley transform, to the measure (0.11). 

For real values of the parameter s the expression (1.2) takes a simpler form 

N 

const J'! ( X J ~ x kf II^ 1 + X ])~ S ~ N ' seR - 

l<j<k<N j=l 
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Our aim is to compute the correlation functions of the measure (1.2). We remark 
that (1.2) is an orthogonal polynomial ensemble (see [Me], [NW]) corresponding to 
the weight function 



<t>{x) = (l+ix)- S - N (l-ix)-~ S - N = (l + x 2)-« a -JV e 29 fl Arg(l+ix) j jgl, (1.4) 

We call it the Nth. pseudo-Jacobi ensemble. The reason for this term is explained 
below. For generalities about orthogonal polynomial ensembles, see, e.g., [Me], 
[NW]. 

Let p = 1, Pi, P2, ■ ■ ■ denote the monic orthogonal polynomials on R associated 
with the weight function (1.4). Since for any s, <p{x) has only finitely many mo- 
ments, this system of orthogonal polynomials is finite. Specifically, it follows from 
(1.3) that the polynomial p m (x) exists if to < + N — |. 

According to a well-known general principle (see, e.g., [Me]), the correlation 
functions in question are given by determinantal formulas involving the Christoffel- 
Darboux kernel 



N-l 

E 

m=0 



Pm(x')Pm{x") 
\\Pm\\ 2 



(1.5) 



By the assumption 5fe > — |, the polynomials up to the order m = N — 1 exist, so 
that this kernel makes sense. 

The orthogonal polynomials p m are known. They were introduced by V. Ro- 
manovski in 1929, see [Ro], and studied recently by P. A. Lesky [Lesl, §5], [Les2, 
§1.4]. They are called the pseudo-Jacobi polynomials, which explains the choice of 
the name for the ensemble (1.2). 

Let 



a, b 
c 



E 

n=0 



a(a + a) . . . (a + n - 1) • b(b + 1) . . . (b + n - 1) 
c(c + 1) . . . (c + n — 1) • n! 



denote the Gauss hypergeometric function. 

Proposition 1.2. Letm < ^ts+n—^, so that the rath monic orthogonal polynomial 
p m with the weight function (1.4) exists. Then it is given by the explicit formula 



Pm(x) = (x 



i) m 2F 1 



— m, s + N — m 
2Ks + 2N-2m 



1 + ix 



(1.6) 



and its norm is given by 

\\p m (x)\\ 2 = p 2 m (x)(j)(x)dx 



7t2~ 



oo 
25fs 



22(AT-m-l) 

where we use the notation 



23fe + 2(N - m) - 1, 23fo + 2(N - to), to + 1 
s + N -m, s + N -m, 29fe + 2N -m 



(1.7) 



a, 6, 
c, d, 



r(a)r(ft) 
r( c )r(d) 



Proof. These formulas can be extracted from [Lesl, §5], [Les2, §1.4]. Another way 
to get them is to use a general method described in [NU]. This method holds for 
any orthogonal polynomials of hypergeometric type and allows to compute all the 
data starting from the differential equation. In our case the differential equation 
has the form 

-(1 + x 2 )p'^ + 2(-3?s + (9fa + N - l)x)p' m + m(m + 1 - 29fa - 2N)p m = 0. (1.8) 

□ 

Note the symmetry property 

Pm(-X) = (-l) m Pm (x) \ a „ s . (1.9) 

It follows from the symmetry of the weight function 

(j){- X ) = 4>(x) \ S ^ E 

and can be verified directly from the expression (1.6). 

To compute the Christoffel-Darboux kernel we will use the classical formula 

N-l 



m=0 



Pm{x')Pm{x") 
llPmll 2 



1 p N (x')p N -i(x") - p N -i(x')p N (x") 



\Pn-i\ 



x' — x" 



(1.10) 



If the parameter s satisfies the stronger condition Jfe > | then the polynomial 
Pn(x) exists and the formula holds. Since all the terms in the left-hand side 
depend analytically on s and s, we can use the formula for s with \ > > — | 
as well with understanding that the kernel is obtained by analytic continuation in 
s and s viewed as independent variables (or, equivalently, by analytic continuation 
in the variables s and s + s). 

Note that the trick with analytic continuation is actually needed only for the 
values of s on the vertical line = 0, because a singularity in the expression (1.6) 
for m = N arises for = only. 

The next lemma makes it possible to get an alternative expression for the 
Christoffel-Darboux kernel. Its advantage is that all the terms have no singularity 
in the whole region JRs > — |. 

Lemma 1.3. Set 

2iNs 

p N { X ) = PN (X) - 2Mm8 + 1) PN-l(x). (1-11) 

This polynomial, initially defined for Sfts > \, actually makes sense for > — \, 
as follows from the explicit formula 

p N (x) = (x - i) N 2 F! 



-N + l, s + 1 
2Ks + 2 



1 + ix 



(1.12) 



Proof. Indeed, using the power series expansion of the hypergeometric function it 
is readily verified that the following general relation holds: 



a, b 
c 



— 2-^1 



a, b 
c+1 



+ 



abz 



c(c+l) 

From (1.13) and (1.6) we easily get (1.12). □ 
We summarize the above results in the following 



a+ 1, b + 1 
c + 2 



(1.13) 



Theorem 1.4. The correlation functions of the Nth pseudo-Jacobi ensemble (1.2) 
have the form 

p^ N \x u ...,*„) = det^'^, x,)]^ (1.14) 

a kernel K^ s ' N \x' , x") defined on R x R. 
TTws kernel is given by the formulas 

"29fa + JV + 1, s + 1, s + l' 
7T iV, 23fo + 1, 2Ks + 2 



o25Rs 

ir^xV) = - — r 



x ^(x>W^-rW*W*") (L15) 



x 1 — x" 



or, equivalently, 



o25Rs 

K^ s ' N \x', x") = r 



7T 



23?s + Ar + l, s + 1, s + 1 
iV, 23fo + 1, 23fo + 2 



x 



p Ar (x')Piv-i(x")-Piv-i(x')Piv(^) 



x' — x" 



where 

0(x) = (l+ix)- s ~ N (l-ix)-°- N = (l+.r 2 ) 
and 



2^ -dts-N e 2Qs Arg(l+ix) 



V^x 7 )^ 77 ) , (1.16) 
(1.17) 



x G 



Pat(x) = {x-i) N 2 Fi 



p N . 1 (x) = (x-i) N - 1 2 F 1 



p N (x) = (X - 4)^2^1 



— iV, s 


2 


2Ks 


1 + ix 



-N + l, s + 1 
2Ks + 2 



1 + zx 



—A/", s 


2 


23fo + 2 


1 + ix 



(1.18) 
(1.19) 
(1.20) 



Note that the expression (1.15) is directly applicable when the parameter s does 
not lie on the line = while the expression (1.16) makes sense for any s with 
3?s>-§. 

Proof. A standard argument from the Random Matrix Theory, see, e.g., [Me] shows 
that the correlation functions are given by the determinantal formula (1.14), where 
the kernel is equal to the Christoffel-Darboux kernel (1.5) multiplied by the factor 
a/ (p(x')(p(x"). Together with (1.6), (1.7), (1.10) this implies the expression (1.15) 
for the kernel. The alternative formula (1.16) then follows from Lemma 1.3. □ 

Remark 1.5. For s = the polynomial p^ can be defined by taking the limit 
as s — > along the real line. From the hypergeometric series it is easy to get the 
following expression: 

(x + i) N + (x - i) N 



Likewise, we get 



Pn(x) | s =o= 



Pn-i(x) \ s =o- 



(x + i) n -(x-i) 
2iN 



N 



It follows that the Christoffel-Darboux kernel (1.10) is an elementary expression. 
This agrees with the fact that for s = our ensemble is related (via the Cayley 
transform) to the Dyson ensemble. 
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2. The scaling limit of the correlation functions 



In this section we compute the scaling limit of the correlation functions of the 
pseudo-Jacobi ensemble as the number of particles goes to infinity. The limit 
correlation functions have a determinantal form, and we express the correlation 
kernel through the confluent hypergeometric function. 

Recall the definition of the confluent hypergeometric function: 



lF! 



a 






z 


c 





q(q + l) ...(a + n-l) ^ 



n=0 



c(c+ 1) . . . (c + n- 1) • n\ 



see, e.g., [Er, 6.1]. 

Let us rescale the correlation functions Pn of the pseudo-Jacobi ensemble 
(see (1.14)) by setting 



p^ N \x u • • • , x n ) = N n ■ pt N) (Nx u . . . , Nx n ). 

Note that the factor N n comes from the transformation of the reference (Lebesgue) 
measure dx\ . . . dx n . We will assume that the variables range over the punctured 
real line R*, not the whole line R, as before. 

Theorem 2.1. Let > —\, as before. For any n — 1,2,... and x\, . . . , x n G R* 

there exists a limit of the scaled nth correlation functions pn' N ^ as N — > oo; 

lim pi s > N \ Xl ,...,x n ) = det iK^ix^Xj) 



Here the kernel K^ s,00 \x\x") on 



K^°°\x',x") = — r 
V ' ; 2tt 



s+ 1, s + 1 
23fe + 1, 23fo + 2 



x R* is as follows 

P{x')Q{x")-Q{x')P{x") 



P{x) = 

Q(x) = - 

x 

Or, equivalently, 
K^°°\x',x") 



e -i/x+7r9s-sgn(x)/2 ^71 



e -i/x+7r9s-sgn(x)/2 ^ 



— 


x" 


s 


2i 




2Ks 


X 


1 


s + 1 


2i 


29fo + 2 


X 



(2.1) 



P{x) 



2tt 

2 

a; 



s+ 1, s + 1 
23fe + 1, 23fo + 2 



P{x')Q{x") - Q(x')P(x") 



g— i/x+7r£$s-sgn(x)/2 Jp 



x' - 


-x" 


s 


2i 


29fo + l 


X 



(2.2) 



T/ie Zzmzt is uniform provided that the variables x±, . . . ,x n range over any com- 
pact subset o/R*. 

Comments. 1. As in Theorem 1.4, the first formula, (2.1), is directly applicable 
provided that s does not lie on the line 5fe = 0, while the second formula, (2.2), 
holds for any s with > — |. 

ll 



2. The kernel K^ s, °°\x', x") can be expressed through the M-Whittaker func- 
tions, see [Er, 6.9] for the definition. Namely, 

iirs sgnjx) [ 21 \ . . i7r(£+l) sgn(x) I 2% \ 

P{x) = e —M_ iQSjUs _i \ -j , Q(x) = e a M_ iQs ^ s+ ± 2 ^-J • 

(2.3) 

3. The symmetry property (1.9) of the pseudo-Jacobi polynomials implies that 

P(-x) = P(x) \ a „ s , Q(-x) = -Q(x) \ a „ s , (2.4) 

which can also be verified directly from (2.3) by making use of the formula [Er, 
6.9(7)]: 

M K Jt) = e u <^)M_ K J-t), e=( 1 ' > °' 

It follows that the correlation kernel K^ s,00 '(x' , x") remains invariant when x', x", s 
are replaced by —x', —x", s (there is one more change of sign in the denominator 
{x'-x")). 

4. Formula (2.4) implies that the functions P(x) and Q(x) are real-valued, 
which agrees with the fact that the pseudo-Jacobi polynomials have real coefficients. 
Hence, the kernel K^ s,oc \x' , x") is real symmetric. 

5. When s is real, the confluent hypergeometric function \F\ turns into the 
Bessel function, and the expressions for P and Q can be written as follows: 

P{x) = 2^-^T(s + l/2)M-V2j s _ 1/2 (_L) , 

Q(x) = sgn(x)2 2s+1 / 2 T(s + 3/2)\x\- 1 / 2 J s+1/2 . 

6. For s = the Bessel functions with indices ±| degenerate to trigonometric 
functions, and we get 

P(x) \ a=0 = cos(i), Q(x) \ a= o= 2sin(i), 
K^\x',x") = - SH f T ~ l f ) . 



TV X 1 — X" 



Changing the variable, y = and taking into account the corresponding trans- 
formation of the differential dx we get the sine kernel, in accordance with (0.9). 

Proof of Theorem 2.1. We will show that 

lim (sgn(x') sgn(x ,/ )) 7V 'N • K^ N) {Nx' ,Nx") =K^°\x\x"), x',x" G M*, 

AT— >oo 

uniformly on compact sets in M*. Note that the factor (sgn(x') sgn(x")) N does not 
affect the determinantal formula. 

We start with the formula (1.15). First of all, we remark that 

T(2St8 + N + l) ms+1 
T(N) 
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which easily follows from the Stirling formula. 
Next, we will examine the asymptotics of 

p N (Nx)y/(/>(Nx), p N - 1 (Nx)y/(/>(Nx), N^oo. 

Here we will assume that x is not a real but a complex variable ranging in a 
neighborhood of a point xq G R*. This will allow us to overcome the difficulty 
related to the singularity x' — x" = in the denominator of (1.15) by making use 
of the Cauchy formula. 

The asymptotics of the hypergeometric functions entering the formulas (1.18) 
and (1.19) is as follows: 



lim 2F1 



-N, s 
2^s 



lim 2 Fi 



-N +1,8+1 

2^s + 2 



1 + iNx 
2 



= 1^1 



s 



2i 

x 



1 + iNx 

Indeed, this is a special case of the well-known limit relation 





s + 1 


2i 


= 1^1 


2$ts + 2 


X 



lim 2F1 



a, b 


z 




b 






= iF t 




z 


c 


a 




c 





zeC. 



This can be readily verified by making use of the integral representation of the 
hypergeometric function written in the form 

= r(c) ' ' 



a, b 
c 



+ 



1 



r(6) r(c - b) ' (1 - te/a) a 

where the brackets denote the pairing between a generalized function (which in the 
present case is supported by [0, 1]) and a test function, and t is the argument of 
the both functions. Note that the limit is uniform provided that z ranges over a 
bounded set of C. 

The asymptotics of the remaining terms looks as follows: 

lim (+l) N (Nx - i) N y/^{Nx) ~ iV- Ks (±x)- Ks e- l/x e ±7r3s , 

where ± is the sign of 5fa and the limit is uniform on compact subsets in the open 
right or left half-plane. Indeed, assume §lx > 0. In the transformations below any 
expression of the form z c with c G C is understood as a holomorphic function in 
the domain C \ (—00, 0]. We have 

(Nx - i) N v^iVaO = (Nx - i) N (l + iNx)~ (s+N)/2 (l - iNx)~^ +N)/2 
= (Nx) N (iNx)-^ s+N ^ 2 (-iNx)-^+ N ^ 2 

N / , \ -( s +N)/2 / 1 N _(f+JV)/2 



X 



1 



Nx 



1 + - 



1 



iNx 



1 



iNx 



N -Us x -Us i -(s+N)/2^_ i y(s+N)/2 

N 



X 



Nx 



1 + - 



1 \ 



-O+A0/2 



iNx 



iNx 



-(s+N)/2 



For < the argument is similar. 

Combining all these asymptotics we get the desired result. 
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□ 



3. The Hua-Pickrell measures 



In this section we define the Hua-Pickrell measures. They form a 2-parameter 
family of L r (oo)-invariant probability measures on the space of infinite Hermitian 
matrices. 

Let H(N) denote the real vector space formed by complex Hermitian N x N 
matrices, N = 1, 2, ... . Let H stand for the space of all infinite Hermitian matrices 
X = [Xij]%> j=1 . For X e H and N = 1,2, . . ., we denote by 6 N (X) e H(N) the 
upper left N xN corner of X. Using the projections 6n- H — > H(N), N = 1,2,..., 
we may identify H with the projective limit space \im H(N). We equip H with the 
corresponding projective limit topology. We will also use the Borel structure on H 
generated by this topology. 

Let U(N) be the group of unitary N x N matrices, N = 1, 2, ... . For any N, we 

\u 1 

embed U (N) into U (N+l) using the mapping u i— > _ ^ . Let U (oo) = hm £7(A/") 

denote the corresponding inductive limit group. We regard U (oo) as the group of 
infinite unitary matrices U = [Uij]°° =1 with finitely many entries Uij ^ dij. The 
group U(oo) acts on the space H by conjugations. 

Proposition 3.1. For any s G C, Ks > — ^, there exists a probability Borel mea- 
sure mS s > on H, characterized by the following property: for any N = 1, 2, . . . , the 
image of under the projection On is the probability measure m^ s,N ^ on H(N) 
defined by 

m( s ' N \dX) = (const^)- 1 det((l + iX)- s ~ N ) det((l - iX)-~ s ~ N ) 

N 

x II dX n II d(MX jk )d(ZX jk ), 

j=l l<j<k<N (3-1) 

N 



The measure is invariant under the action ofU(oo). 

Comments. 1. For X e H(N) and z e C we define the matrix (1 ± zX) 2 by means 
of the functional calculus. This makes the expression 

f N (X) = det((l + iX)- s ~ N ) det((l - iX)-~ s ~ N ), X e H(N) 

meaningful. Equivalently, denoting by xi, . . . , xn the eigenvalues of X, 

N 

MX) = ]J(1 + iXi)-'- N (l - ixj)-*-" , (3.2) 

3=1 

where we use the analytic continuation of the function (. . . ) z from the positive axis 
to the region C \ (— oo, 0]. 

2. When s is real, the expression (3.2) takes a simpler form 

f N (X) = (det(l + X 2 ))- s - N , XeH(N), sGR. 
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Proof. Step 1. First of all, note that /at (AT) > 0. Therefore, if is integrable 
then it defines a finite measure on H(N). 

Fix N > 2 and write an arbitrary matrix X G H{N) in the block form 

Y £' 



X = 



C t 



YeH(N-l), £gC 



N-l 



t g 



We shall prove that for any Y G H(N — 1) the integral of /at over £, t is finite and 
has the following value 

JV 

Hd^Qd^Q-dt 

7r Ar r(s + s + AT) 



(€,*)et 



y 

r 



= /iv-i(y) 



(3.3) 



For N = 1, y and t disappear, and the claim is that the integral of fi over R is 
finite and given by 

yrr(s + s + 1) 



h{t)dt 



(l + it)- s - L (l-it) 



-s-1 



dt 



(3.4) 



t6M J-oo 2'+T(8+l)T(S+l)- 

Let us show that (3.3) and (3.4) imply the proposition. Indeed, using induction 
on N we see that the integral of over H(N) is finite and equals const at. Thus, 
the measure m^ s ' N ^ is correctly defined for any N. 

Next, (3.3) implies that the measures m^ s,N ' and m^ s,N ~ 1S) are consistent with 
the projection X \— > Y from H(N) to H(N — 1). Since H coincides with the 
projective limit of the spaces H(N) as N — > oo, we conclude that the measure 
exists and is unique. 

Finally, m^ s ' is invariant under the action of U(po), because each 

m (s,N) is 

invariant under the action of U(N) for all N = 1, 2, ... . 

Step 2. We proceed to the proof of (3.3) and (3.4). The latter formula follows 
from formula (3.9) in Lemma 3.3. The former formula is proved in [Hua, Theorem 
2.1.5] for real s, and we employ his argument with slight modifications. Applying 
Lemma 3.2 (see below) we get 

f N (X) = det((l + iY)— ")(1 + tt + C(l + tY)-^)- 3 -" 

x det((l - iY)-~ s - N )(l -it + (1 - iY)- 1 ^-*-" ■ (3.5) 

Next, note that the integral (3.3) is invariant under the conjugation of Y by a 
matrix V G U(N — 1). Indeed to see this, we use the invariance of the function 
and make a change of a variable, h- > £. Therefore, without loss of generality we 
may assume that Y is a diagonal matrix. Denoting its diagonal entries (which are 
real numbers) as yi, . . . , x/n-i and using (3.5) we reduce the integral (3.3) to 

N-l 

^(l + ^2/ J )- s - A^ (l-^•)- s "- A^ 



x 



N-l 



X 



(C,t)6C JV - 1 x 



N-l 



-i t 




iV-l 



-s-iV 



1^ 

+ 2/- 



s-iV 



AT 



J=l 



This integral is easily simplified. First, assuming the variables £1, . . . , £jv-i fixed, 
we make a change of variable 



AT-l 



Next, we change the variables £j, 
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j = l,...,iV-l, 



which gives rise to the factor ]1(1 + y,) 2 . Then (3.6) is reduced to 

(1 -i Vj )-'- N+1 



N-l 

ri( i +^)" s " vii; 

3 = 1 



X 



N-l 



(^,t)ec JV - 1 xiR 

■s-JV 



AT-1 



9-iV 



AT 



n«,M^)-cft. (3.7) 

J'=l 



Setting r = Y^ \£j\ 2 we readily reduce (3.7) to 

N-l 



r AT— 1 



-s-JV+1 



^ / / ( 

r(iv-i) y^oiteiR 



(l + r + zt)- s - JV (l + r-zt) 



-s-N r N-2 drdt 



By Lemma 3.3, the double integral is finite and its value is given by formula (3.9) 
where we substitute a = s + N, b = s + N (the assumption of Lemma 3.3 is satisfied 
because > —\)- This implies (3.3). □ 

We proceed to the proof of two lemmas which were used in Proposition 3.1. 

Lemma 3.2. Consider the N x N matrix analog of the right halfplane in C: 

Mat (AT, C)+ = {Ae Mat(iV, C) | A + A* > 0}. 

Write N x N matrices in the block form according to a partition N = Ni + N 2 , 



An A 12 
A21 A22 



Then for zGC and A e Mat (AT, C)+ the following relation holds 

det(A 2 ) = det(A^) det((A 22 - A 21 A^A 12 ) Z ). (3.8) 



Proof. First of all, we show that both sides in (3.8) make sense. Note that if A e 
Mat (A 7 ", C)_|_ then any eigenvalue A of A lies in the open right halfplane (indeed, if 
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£ eC N is an eigenvector with the eigenvalue A then < ((A + A*)£, £) = 2KA(£, £), 
which implies 9?A > 0). Therefore, we can define the matrix A z by means of the 
functional calculus. Next, note that the matrices An and A22 — A2\A^Ai2 also 
belong to the matrix right halfplanes. Indeed, for the former matrix this is evident, 
and for the latter matrix this follows from the fact that A -1 e Mat(AT, C) + and 



A22-A 21 A^ 1 1 A 1 2 = ((A- 1 : 



22, 



Thus, the expressions (. . . ) z in the right-hand side of (3.8) are well-defined. 

Since both sides of (3.8) are holomorphic functions in A in the connected region 
Mat (AT, C)+, we may assume, without loss of generality, that A lies in a small 
neighborhood of the matrix 1. Then we may interchange the symbol of determinant 
and exponentiation. This reduces (3.8) to the classical formula for the determinant 
of a block matrix, 

det A = detAn • det(A 22 - A 2 iA^A l2 ). 
See, e.g. [Gantmakher, Ch. II, §5.3]. □ 
Lemma 3.3. We have 

-bN-2, 



TV — 1 f r 

1 \w — -U J r >o JteR 



n N T(a + b — N) 

a,6eC, 3?(a + 6)>iV, N > 1. (3.9) 



2 a + b - 2 T(a)T(b) ' 
and 

j t Jl + it)- a (l-it)- b dt= ^fef^^ , a,6GC, »(o + 6)>l. (3.10) 

Proof. The integral (3.10) is readily reduced to a known integral, see [Er, 1.5 (30)]. 

To evaluate the integral (3.9), make a change of variable, t 1— > (1 + r)t. The 
integral splits into the product of two integrals, one of which is (3.10) and the other 
one is the integral 

Jr>o [ } V{N-l) dr r(fl + 6-l)' 

This proves (3.9). 

Note also that (3.10) is a degeneration of (3.9), because r+~ 2 /T(N — 1) degen- 
erates to the delta function 8(r) at N = 1. □ 

Let C+ denote the right halfplane. Following Neretin [Ner2] we define a map 

H 3 X = [X jk ]™ k=1 » (Ci, C2, • • • ) G R X C~ (3.11) 



as follows. For any N = 2, 3, ... , write the matrix 6n(X) = [Xj k ]f k= i in the block 
form 

e N -i(x) £' 



and then set 



Civ = ^+r(i+^iv-i)" 1 eec + . 

Finally, set Ci = X X1 e M. 
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Proposition 3.4. The pushforward of the measure under the map (3.11) is 

a product measure /ii x /i 2 x ... on the space R x . Here fxi, ^2, ■ ■ ■ are the 
following probability measures: 

nidt) = 2S+ ^; + ^ (s " +1) (i + - ity^dt 

7Tl (S + S + 1J 

and, for N >2, ( = r + it E C+, 

(3.12) 

Proof. This follows from the proof of Proposition 3.1. □ 

Theorem 3.5. The Hua-Pickrell measures are pairwise disjoint. I.e., if s' , 
s" are two distinct values of the parameter s then there exist two disjoint Borel sets 
in H supporting the measures m^ s ) and m^ s \ respectively. 

Proof. We will apply Kakutani's theorem [Ka]. Assume first we are given two 
probability measures, \j! and //', defined on the same Borel space. Take any measure 
v such that both fx' and fx" are absolutely continuous with respect to v. For instance, 
v = fx' + fx" . Denote by fx' jv and fx" jv the respective Radon-Nikodym derivatives. 

The measure • v does not depend on the choice of v. Denote it by \J fx' fx" 

and set 

(//, fx") = / y/n'n". 



We have < (fx' ', fx") < 1. Moreover, (fx 1 ', fx") = 1 is equivalent to fx' = fx" while 
(fx' , fx") = exactly means that fx' and fx" are disjoint. 

Next, assume fx' = fx'± x fx' 2 x . . . and fx" = fx" x fi'^ x . . . are two product prob- 
ability measures defined on the same countably infinite product space. Kakutani's 
theorem [Ka] says that fx' and fx" are disjoint if the infinite product YIn^^'n^ I^'n) 
is divergent, i.e., the partial products tend to 0. 

Finally, consider the product space M. x and take as \x' and fx" the pushfor- 
wards of measures irS s ) and m^ s \ respectively, as explained in Proposition 3.4. 
We prove that fx' and fx" are disjoint. Then this immediately implies the same for 
the initial measures m^ s ) and m^ s \ 

We drop the index N = 1 which plays a special role and calculate the integral 
defining (fx' N , fi%) for N >2. By (3.12) and (3.9) we get 



(fl N , /x N ) 



T(s' + N)T(s' + N)T(s" + N)T(s" + N) T(s + s + N) 



T(s' + s' + N)T(s" + s" + N) T(s + N)T(s + N) 
s' + s" 



The classical asymptotic formula for the ratio of two T-functions, see [Er, 1.18(4)], 
implies that 

T(z + N)T(z + N) 1 _f£ + / / l 



T(z + z + N)T(N) N \N 2 
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It follows that 

| s ' _ s"| 2 / l \ 

Thus, the product of {n' N , Aijv)' s is divergent. □ 

4. Ergodic measures 

In this section we recall the classification theorem and some other known results 
on L r (oo)-invariant ergodic probability measures on the space of infinite Hermitian 
matrices. 

Consider the natural embeddings 

H(N) — > H(N + 1), A i-> 

and denote by H(oo) the corresponding inductive limit space limff (AT). Then 
H(oo) is identified with the space of infinite Hermitian matrices with finitely many 
nonzero entries. We equip H(oo) with the inductive limit topology. In particular, 
a function /: H(oo) — > C is continuous if its restriction to H(N) is continuous for 
any N. 

There is a natural pairing 

H(oo) x H -> R, (A, X) ^ tr(AY). 

if is the algebraic dual space of H(oo) with respect to this pairing. 
Using the map 

we can identify H, as a topological vector space, with the infinite product space 
R°° = RxRx • • • . Under this identification, H(oo) C H turns into lRg° := |J n>1 R n , 
and the pairing defined above becomes the standard pairing between Mq° and 

Given a Borel probability measure M on i7, we define its Fourier transform, or 
characteristic function, as the following function on H(oo): 

A» f e ltT ( AX) M(dX). (4.1) 
Jh 

The group U(oo) acts by conjugations both on H(oo) and H, and the pairing 
between these two spaces is clearly U(oo) -invariant. Each matrix from H(oo) is 
conjugated to a diagonal matrix diag(ri, r2, ■ ■ ■ ) with finitely many nonzero entries. 
It follows that the Fourier transform of a U (oo)-invariant measure on H is uniquely 
determined by its values on diagonal matrices from H(oo). 

Set 

n = {uj = ( a +, a", 71, 5) € R 2oo + 2 =M 00 xl 00 xKxR 

a+ = (a+ > a+ > • • • > 0), a" = (af > «2 > • • • > 0)» 

7i el, 5>0, ^K + ) 2 + ^K") 2 <5}- 

This is a closed region in IR 2oo+2 . 
Denote 

7 2 = * - B«+) 2 - $>n 2 > o. 

In this notation we have 
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Proposition 4.1. There exists a parametrization of ergodic U(oo) -invariant prob- 
ability measures on the space H by points of the space O. Given 10, the Fourier 
transform (4.1) of the corresponding ergodic measure M w is given by 

I e % tr(diag(ri,...,r„,0,0,...)X) j^-w/^j^ 

JxeH 




oo 

2 -i — r P 

l H r j— ll r " 



n n- 



Proof. See [Pi2, Proposition 5.9] and [OV, Theorem 2.9]. □ 

Remark 4.2. If only one of the parameters af , 71, 72 is distinct from then 
the corresponding ergodic measure is called elementary. See [OV, Corollaries 2.5- 
2.7] for a description of the elementary measures. Note, in particular, that the 
elementary measures corresponding to the parameter 72 are standard Gaussian 
measures on H, see [OV, Corollary 2.6]. Since the expression of Proposition 4.1 
is multiplicative with respect to the coordinates of u, any ergodic measure is a 
convolution product of elementary ergodic measures. 

For iV = 1, 2, . . . , let Sjv C ~R. N denote the set of iV-tuples of weakly decreasing 
real numbers: 

A= (Ai > ••• > X N ). 

Given A G Sat, let Orb(A) denote the set of matrices X e H(N) with eigenvalues 
Ai, . . . , Ajv- The sets of the form Orb(A) are exactly the {7(iV)-orbits in H(N). 
Given A C Sat, we set 

r max(Aj,0) 
a+(A)= ' *=1.-^ 

[0, i = AT + 1, AT + 2,... , 

{ max(-A A r + i- i ,0) . _ 
0, i = N + 1, AT + 2,.... 

Equivalently, if fe and I denote the numbers of strictly positive terms in {af} and 
{a~}, respectively then 

A = (a+(A), . . . , a+(A), 0, . . . , 0, -af(A), . . . , -a7(A)). 

Further, we set 

A, A.v 



c(A) = ^a+(A)-^a-(A) = 



N 



d(A) = E(a+(A)) 2 + f>"(A)) 2 = + ^ 

i=l i=l 



A" 



AT2 



By virtue of [OV, Theorem 3.3], any ergodic measure can be approximated by 
orbital measures on the spaces H(N) as — > 00. The next result provides an 
explicit description of the approximating orbital measures. It also clarifies the 
meaning of the parameters in Proposition 4.1. 
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Proposition 4.3. Let {Orb(\( N >) | A^ G Sat} be a sequence of orbits and let 
{M( N >} be the sequence of the corresponding orbital measures on the spaces H(N), 
N = 1, 2, . . . . We view each M^ N > as a measure on H. 

The measures AfW weakly converge to a measure M on H, i.e., (f,M( N )) — > 
(/, M) for any bounded continuous function f on H, if and only if there exist limits 

af= lim af(A^), i = 1, 2 



N 



7l = lim c(A (A °), 



N 

5= lim d(A (A °). 

If this condition holds then the collection u> = ({a^ 1- }, 71, S) is a point of Vt 

and the limit measure M coincides with the ergodic measure M u . 

Proof. See [OV, Theorem 4.1.] □ 

Proposition 4.4. For any U (00) -invariant probability measure M on H there 
exists a probability measure P on O such that 

M = I M^Pidw), 
Jn 

which means that for any bounded Borel function f on H , 

(f,M}= [ (f,M»)P(dw). (4.2) 
Jo, 

Such measure P is unique. Conversely, any probability measure P on O arises in 
this way from a certain measure M . 

Proof. This follows from Theorem 9.1 and Proposition 9.4. □ 
We will call P the spectral measure for M. 

5. Approximation of spectral measures 

In this section we show that the spectral measure for a U (00) -invariant prob- 
ability measure M on H can be obtained as a certain limit of finite-dimensional 
projections of M. 

For X G H, let \( N '(X) G §W denote the spectrum of the finite matrix 9n(X) G 
H(N). Let us say that X G H is regular if there exist limits 

a±{X)= lim af(X^(X)), i = l,2 

N -^00 

7 i(X)= lim c(\W(X)), (5.1) 
= lim d(\( N \X)). 



N- 



Let if r eg C H denote the subset of regular matrices in H. Since is a 

continuous function in X for any N, the functions a^(A^)(X)), c(A^ Ar - ) (X)), and 
d(\( N ^ (X)) are also continuous. It follows that H reg is a Borel subset of H (more 
precisely, a subset of type F a g). 
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Theorem 5.1. Any U(oo) -invariant probability measure on H is supported by 
H re g . 

Proof. First, let M be an ergodic U{oo) -invariant probability measure on H. By 
Vershik's ergodic theorem (see [OV, Theorem 3.2]), M is concentrated on the set 
of those X £ H for which the orbital measures Orb(AWpO) weakly converge to 
M. By Proposition 4.3, this set consists exactly of those X for which the limits 
(5.1) exist and coincide with the parameters of M given in Proposition 4.1. All 
such matrices X belong to H ieg , so that M is supported by H reg . Thus, the claim 
of the theorem holds for ergodic measures. 

Now let M be an arbitrary £7(oo)-invariant probability measure on H and P 
be its spectral measure. Apply (4.2) by taking as / the characteristic function of 
the set H reg C H. We have (/, M w ) = 1 for any uj e O. Since P is a probability 
measure, we get from (4.2) that (/, M) = 1. Therefore, H reg is of full measure with 
respect to M. □ 

Let 7T : H reg — > O denote the map sending X e H reg to the point u with the 
coordinates defined by (5.1). This is a Borel map, because it is the pointwise limit 
of a sequence of continuous maps. 

Theorem 5.2. Let M be a U (oo) -invariant probability measure on H and let 
M \h ics be the restriction of M to H reg , which is correctly defined by Theorem 
5.1. 

The pushforward of the measure M |# rog under the Borel map it introduced above 
coincides with the spectral measure P. 

Proof. Let F be an arbitrary bounded Borel function on O and / be its pullback 
on H reg . We must prove that (/, M) = (F, P). 
By definition of P, we have 

(f,M}= [ (f,M»)P(dw). 
Jo, 

On the other hand, we know that for any u G O, the measure is supported 
by 7r _1 (a;) C H reg (see the beginning of the proof of Theorem 5.1). Finally, by the 
definition of /, we have / |„.- i( w )= F{u), so that (/,M U ) = F(u). 
Therefore, the integral in the right-hand side is equal to (F, P). □ 

For N = 1,2, let itn : H ^> Q C ]R 2oo + 2 denote the composition of the maps 
H3X^ \( N \X) E §at and § N 3 A i-> ({a+(A)}, {a"(A)}, c(A), d{\)) E O. 

Theorem 5.3. Let M be a U(oo) -invariant probability measure on H, P be its 
spectral measure, and Pn be the pushforward of M under the map '■ H — > O 
defined above. 

Then Pn weakly converge to P as N — > oo. That is, for any continuous bounded 
function F on O, 

hm (F,P N )^(F,P N ). 

Proof. By Theorem 5.1, H Yeg C H is of full measure with respect to M, so that we 
may view (H reg , M) as a probability space. 
We have 

7T N {M) = P N , 7T(M) = P. 

22 



Indeed, the first equality follows from the definition of Pn and the fact that H reg 
is of full measure, and the second equality is given by Theorem 5.2. 

Next, by the very definition of H reg , we have 7T/v(t) — * for any t G H reg as 
N — > oo, where the limit is taken with respect to the coordinatewise convergence 
on the space R 2oo+2 . Since F is continuous, we get F(7Tjv(t)) — > F(n(t)). That is, 
Fott n converges to F on at any point t G H reg . Since these functions are uniformly 
bounded, it follows that 

/ (F0 7T N )(t))M(dt) -> / (F0 7T)(t))M(dt). 

Since 7nv(M) = PW and tt(M) = P, 

( (FoTr N )(t))M(dt) = (F,P N ), I (FoTr)(t))M(dt)=(F,P). 

Consequently, (F, Pn) -»• (P,^)- □ 

6. The main result 

Let s G C, 3?s > — \. Consider the Hua-Pickrell measure m^ s \ Let P( s ) be its 
spectral measure and V^ be the corresponding point process on R*, see (0.8). 
In this section we prove the following theorem which is our main result. 

Theorem 6.1. The correlation functions of the process exist and coincide 
with the limit correlation functions from Theorem 2.1. 

Let X range over H reg . Recall that in §5 we attached to X two monotone 
sequences {af(X)}, {a~(X)} and also, for any iV = 1,2,..., two monotone se- 
quences 

= "/(A (N) (m K>P0 = a-(\W(X))}. 
From these data we form point configurations 

C(X) = {a+(X)} U {-a-(X)}, C N (X) = {a+ N (X)} U {-a~ N (X)}, 

where we omit the zero coordinates. 

Let M be a U(oo) -invariant probability measure on H. We restrict M to H reg , 
which is a subset of full measure, and view (H reg , M) as a probability space. Then 
any quantity depending on X becomes a random variable. 

Let P be the spectral measure of M and let Pn be the finite-dimensional mea- 
sures defined in Theorem 5.3. Recall that Pn approximate P as iV — > oo. 

Let Vn and V be the point processes on M* corresponding to Pn and P, respec- 
tively. We may view Vn and V as the random point configurations Cn(X) and 
C(X), where X is viewed as the point of the probability space (H Teg , M). 

By and pu we denote the kth correlation measures of the processes Vn and 
V, respectively. Note that the very existence of the measures pk is not evident. 
For a compact set A C M* we set 

Ma,n{X) = Card(CVpO n A), M A {X) = Card(C(X) n A). 

These are random variables. 

We know that for any fixed X and for any index % = 1,2,..., af N (X) tends to 

af(X) as iV — > oo. We would like to conclude from this that p^ converges to pk 
as N — > oo. The next lemma says that, under a reasonable technical assumption, 
this is indeed true. 
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Lemma 6.2. Assume that for any compact set id* there exist uniform in N 
estimates 

®Wa,n}<Ci, 1 = 1,2,..., 

where the symbol E stands for the expectation. 

Then for any k = 1,2, ... , the correlation measure p k exists and coincides with 
the weak limit of the measures p k N ^ as N — > oo. The limit is understood in the 
following sense: for any continuous compactly supported function F on (R*) k 

lim (F,p[ N) ) = (F,p k ). 



Proof. Fix a continuous compactly supported function F on It will be con- 

venient to assume that F is nonnegative (this does not mean any loss of generality) . 
Introduce random variables / and f^ as follows: 

f(X)= F(x u ...,x k ), f N (X)= F ( 

ec(x) ec N (x) 

(6.1) 

summed over ordered /c-tuples of points with pairwise distinct labels. Any such sum 
is actually finite because F is compactly supported and the point configurations 
are locally finite. 

By the definition of the correlation measures, 

(F,p k ) = E[f], (F,p k N) ) = E[f N }. 

The correlation measure p k exists if E[/] is finite for any / as above, see, e.g., [Len]. 

Thus, we have to prove that E[/jv] — > E[/] < oo as N — > oo. By a general 
theorem (see [Shir, ch. II, §6, Theorem 4]), it suffices to check the following two 
conditions: 

Condition 1. /jv(£) - ► f(X) for any X e H reg . 

Condition 2. The random variables fx are uniformly integrable, that is, 
sup / f N (X)M(dX) -> 0, as c -> +oo. 

N J{X\f N (X)>c} 

Let us check Condition 1. This condition does not depend on M, it is a simple 
consequence of the regularity property. Indeed, let us fix X e H reg . For any e > 
set 1R £ = R\ (— e, e). Choose e so small that the function F is supported by (M e ) fc . 
Fix j so large that a^(X) < e. Since a^ N (X) — > a^(X), we have ■ < e for 
all N large enough. By monotonicity, the same inequality holds for the indices 
j + 1, j + 2, . . . as well. 

Recall that each point x E Cn(X) has the form x = af N (X) or x = —a~ N (X) 
for a certain index i. It follows that in the sums (6.1), only the points with indices 
i = 1, . . . ,j — 1 may really contribute. Then, using the continuity of F we conclude 
that MX) ^/(X). 

Let us check Condition 2. Choose a compact set A such that F is supported by 
The supremum of F (let us denote it by supF) is finite. We have 



f N (t) <snpF-Af A , N (X)(M A , N (X)-l)...(M A , N (X)-k+l) <su P F-(A/ A)iV (X)) fc . 
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Therefore, the random variables /jv are uniformly integrable provided that this is 
true for the random variables (N"a,n) for any fixed k. But the latter fact follows 
from the assumption of the theorem and Chebyshev's inequality. □ 

Assume that Vn is a determinantal process given by a symmetric nonnegative 
integral operator Kn on That is, the correlation functions have determinantal 
form with the kernel Kn- For a compact set A C K* we denote by Ka,n the 
restriction of the kernel Kn to A. 

Lemma 6.3. Assume that for any compact set A C M* we have an estimate 
iiK A N < const, where the constant does not depend on N. Then the assump- 
tion of Lemma 6.2 is satisfied. 

Proof. Instead of ordinary moments we can deal with factorial moments. Given 
Z = 1,2,..., the Zth factorial moment of Ma,n is equal to 

p\ N \A l ) = \ det[K AiN (x i ,x j )] 1 < iJ <idx 1 ...dxi = l\tr(A l K A , N ). 

J A 1 

Since K a ,n is nonnegative, we have 

tr(A l K AiN ) < tv(® l K AiN ) = (tv(K A , N )) 1 . 

This concludes the proof, because we have a uniform bound for the traces by the 
assumption. □ 

Proof of Theorem 6.1. Take M = and denote the correlation measure p k N ^ 

by p[ s,N) . The latter measure is calculated in §1: it coincides with a scaling of the 

kth correlation function p k ,N ^ (xi, . . . , Xk) for the iVth pseudo-Jacobi ensemble. In 
terms of the corresponding correlation functions, 

p k s ' N \x u ...,x k ) = N k p[ s ' N) (Nx 1 , . . . , Nx k ), x u ...,x k eR*. 

By Theorem 2.1, for each k = 1, 2, . . . , there exists a limit 

lim p^' N) (xi,...,x k ) = p k s, °°\x l ,...,x k ), (6.2) 

N^oo 

uniformly on compact subsets in (]R*) fc . Moreover, the correlation functions have 
determinantal form. It follows that the assumptions of Lemma 6.3 are satisfied 
(indeed, tr K a ,n is simply the integral of the first correlation function p^' (x) 
over A). Consequently, we may apply Lemma 6.2. By this lemma, the correlation 
measures of the process exist and coincide with limits of the measures p k s,N ^ 

as iV — > oo. Therefore, they are nothing else than the measures p k s, °°^ defined by 
the limit correlation functions (6.2). □ 

7. Vanishing of the parameter 72 

In this section we show that the parameter 72 which is responsible for the pres- 
ence of the Gaussian component vanishes for the measure m^°K 

We start with a general result concerning an abstract U (00) -invariant probability 
measure M. As in §6, let Vn and V denote the corresponding point processes on 
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R*, and let p\ N ^ and p\ be their first correlation measures. We assume that 
approach p±, as A" — > oo, in the sense of Lemma 6.2: 

(G,p[ N ^) - for any G G C (R*), (7.1) 

where Co(M*) denotes the space of continuous functions with compact support on 
M*. In §6 we verified that the condition (7.1) holds when M is a Hua-Pickrell 
measure. 

Proposition 7.1. Let M satisfy the condition (7.1). Further, assume that 

lim / x 2 p[ N \dx) = uniformly in N. (7-2) 

s ^°J-e 

Then the spectral measure P of the measure M is concentrated on the subset 
72 = in O. 

Comment. The density of the measure p\ may have a singularity at 0. For instance, 
when M = m^°\ the density function is proportional to 1/x 2 . The condition (7.2) 
means that the densities of the measures p\ , multiplied by x 2 , are uniformly 
integrable about x = 0. 

We need a simple lemma. 

Lemma 7.2. Assume we are given sequences 

a^ N >a^ N >--->0, a^ N > a^ N > • • • > 0, AT = 1,2, 

such that 

lim ajv = af, i = 1,2,... 

and 

CO 

lim ^((a+J 2 + (a^) 2 ) = <J < +oo, AT = 1, 2, . . . 

i=l 

Further, let F(x) be an arbitrary continuous function on R+ swc/i t/iat 

F(x) = x 2 for \x\ < e 

CO 

with a certain e > 0. Set 72 = 5 — (( a T) 2 + ( a 7) 2 ) an< ^ n °t e that 72 > 0. 



4) 2 + (*P 2 " 

i=i 

Then we have 



lim Y^(F(a+ N ) + F(-a- N )) = £(F(a+) + F(-a 4 ")) + 72- 



i=l i=\ 



Proof. Fix /c so large that aJT+i < e, a A T +1 < e. Then a^ +17V < e, a A T +17V < e 
for sufficiently large A" and, moreover, af N < e, a~ N < e for all % > k + 1 by 
monotonicity. Likewise, af < e, a~ < e for i > k + 1. Therefore, 

F(±a±v) = (a^) 2 (for large AT), F(±a±) = (a±) 2 , i>fc+l. 
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It follows that 

oo k oo 

5>Kvv) + F (-a~ N )) = J2( F «n) + F(-a- N )) + E ((a+ N ) 2 + (a~ N f) 

i=l i=l i=k+l 

and similarly 

oo k oo 

3FK + ) + FK)) = B% + ) + f K))+ E (K + ) 2 + K") 2 ) 

i=l i=l i—k+1 

As N — > oo, we have 

A: A: 

E(n<iv) +n-a- N )) - E( f k + ) 

i=l i=l 

by continuity of F, and 

oo oo 

E («n) 2 + k» 2 )- E (k + ) 2 + K") 2 )+72, 

i=k+l i=k+l 



by the assumption of the lemma. This conludes the proof. □ 



Proof of Proposition 7.1. Let A range over -ff reg . Recall the notation a - N (X) and 



(A) introduced in §5 and in the beginning of §6. Let 72(A) denote the value 
of the parameter 72 at the point ir(X) G O, where tt: H reg — > Q is the projection 
defined in §5. Our aim is to prove that 72(A) = almost everywhere with respect 
to the measure M. This implies the claim of the proposition. 

Fix a continuous function F(x) > 0, with compact support on R and such that 
F(x) = x 2 near 0. For any A G -ff r eg set 

00 

<p N (X) = J2(F(a+ N (X)) + F(-a- N (X))), 
i=i 

OO 

(a) = E(^k + (^)) + n-*-(x))). 

i=i 

Applying Lemma 7.2 to the sequences af N = af N (X) and af = af(X), we get 

<p N (X) -> v?oo(A) + 72 (X), A G tf reg • 

The functions ipn(X), ip^^X), 72(A) are all nonnegative Borel functions. By 
Fatou's lemma (see, e.g., [Shir, ch. II, §6, Theorem 2]), 

liminf f ip N (X)M(dX)> I Voo (X)M(dX) + I l2 {X)M{dX). 

Recall that in the beginning of §6 we introduced the point configurations Cat (A) 
associated with an arbitrary A G H Teg . We have 

00 

^ N (X) = J2(F(a+ N (X))+F(-a- N (X))= E F(x), 
*=i xec N (x) 
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so that 

AN), 



I <p N (X)M(dX) = (F,p{> 



Likewise, 

< Poo (X)M(dX) = {F,p 1 ). 



L 



Therefore, 



lmimf (F, p{ N) ) > (F, Pi) + f l2 (X)M(dX). (7.3) 

On the other hand, we will prove that 

limsup(F,p( JV) ) < (F, Pl ). (7.4) 

It will follow from (7.3) and (7.4) that 72 (X) = for M-almost all X, because 
72PO > 0. 

To prove (7.4) we represent F(x), for an arbitrary e > 0, in the form 

F(x) =F £ (x) + G e (x), 
where < F e (x) < x 2 , supp F s C [-£, e] , F £ (x) = x 2 near 0, G e eC (R*). 

Choosing e small enough, we can make (F £ , p\ N ^) arbitrarily small, uniformly in N, 

by virtue of the assumption (7.2). As for (G e ,p\ N ^), it tends to (G e ,pi), by (7.1). 
This concludes the proof of Proposition 7.1. □ 

Theorem 7.3. The spectral measure of the measure is concentrated on the 
set 72 = in O. 

Proof. By virtue of Proposition 7.1, it suffices to verify the condition (7.2). To 
do this, we use the fact that in our case the first correlation function p\ N \x) = 
p^' N \x) has a very simple expression: 

The simplest way to check (7.5) is to use the relationship to the iVth Dyson ensem- 
ble, where the first correlation function is identically equal to N. 

From (7.5) and the trivial estimate ^7^2 < 1 we readily conclude that the 
condition (7.2) is indeed satisfied. □ 

We expect that Theorem 7.3 holds for any Hua-Pickrell measure. 

8. Remarks and problems 

Orthogonal polynomials on the circle. In this paper we deal with the pseudo- 
Jacobi ensemble (1.1) defined by the weight function (1.4) on the real line. Instead 
of this, one could work with the orthogonal polynomial ensemble (0.11). Then we 
need orthogonal polynomials on the unit circle T with the weight function 

(1 + uY(l + u) s = 2 a (1 + cos ip) a e hip , 

where u = e %{p € T, — tt < < n, s = a + ib. 
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For real s, the weight function depends only on $lu = cost/? G [—1,1]. Then 
one can use a general trick described in [Sz, §11.5]. It allows one to express the 
polynomials on T in terms of two families of orthogonal polynomials on the interval 
[—1,1], which, in our case, turn out to be certain Jacobi polynomials. This makes 
it possible to evaluate the Christoffel-Darboux kernel and then pass to a limit as 
N — > oo, which leads to another derivation of Theorem 2.1 (for real s). Perhaps, 
such an approach can be used for nonreal values of s as well. 

Painleve V. Consider a kernel of the form 

P{x')Q{x") - Q{x')P{x") 



K{x\x") 



where the functions P and Q satisfy a differential equation of the form 

: A( X ) 



d 

dx 



P{x) 
Q{x) 



P{x) 
Q(x) 



with a traceless rational 2x2 matrix A(x). Let J be a union of intervals inside the 
real line. Then the Fredholm determinant det(l + K\ j) satisfies a certain system 
of partial differential equations with the endpoints of J regarded as variables, see 
[TW]. In particular, when only one endpoint is moving the corresponding ordinary 
differential equation often happens to be one of the Painleve equations. 

The kernel i^( s '°°) introduced in Theorem 2.1 is not an exception. In particular, 
the function 

satisfies a a-version of the Painleve V equation: 

-{ta"f = (2(ta' -a) + (a') 2 + i(s - s)a') 2 - (a') V " ^)(a' + 2is), 

see [BD] for details. Note that the approach of [BD] is very different from the 
machinery developed in [TW]. 

Infinite measures. The construction of the Hua-Pickrell measures nrS s \ > 
— i, given in §3 can be extended to arbitrary complex values of s. However, when 
< — 7j, ceases to be a probability measure and becomes an infinite measure. 
Its pushforward m^ s ' N ^ under the projection On '■ H — > H(N) makes sense only for 
sufficiently large values of N. Specifically, iV must be strictly greater that — 23?s. 
Then the measure m^ s ' Ar - ) is defined, within a constant factor not depending on N, 
by formula (3.1), where the factor constjv is subject to the recurrence relation 

tv n T(s + s + N) 

const n = const n-i — , _ , „, r n — . r— — . -77 . 

2 s + s + 2N - 2 T(s + N)T(s + N) 

In other words, even if the measures m^ s,N ^ are infinite, their projective limit 
?7i( s ) = |imm^ s ' 7V - ) still exists. The reason is that the fibers of the projection 
H(N) — > H(N — 1) have finite mass with respect to the conditional measures 
provided that iV is large enough. 
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Problem. Define and study the spectral decomposition of the infinite measures 
m^ s \ 3fo < -\. 

Representation— theoretic meaning of £7(oo)-invariant measures on H. Let 

G(N) = U(N) ix H(N) be the semidirect product of the group U(N) acting on the 
additive group H(N) by conjugations. Similarly, set 

G = U(oo) x H(oo) = \m±G(N). 

The groups G(N) are examples of the so-called Cartan motion groups, and the 
group G is an infinite-dimensional version of the groups G(N). 

A unitary representation T of the group G is called spherical if it possesses a 
cyclic unit vector £ which is invariant with respect to the subgroup U(oo) C G. 
There is a one-to-one correspondence between the classes of equivalence of the 
pairs (T, £) and the U(oo) -invariant probability Borel measures M on H. Given 
M, the representation T can be realized in the Hilbert space L 2 (H, M). Elements 
U G U(oo) and A G H(oo) act on functions / G L 2 (H, M) as follows 

(T(U)f)(X) = f(U~ l XU) : (T(A)f)(X) = e^ Ax ^f(X), X G H. 

In this realization, £ is the constant function 1. 

Consider the matrix coefficient <p(g) = (T(g)£,£), called the spherical function. 
Since <p is L r (oo)-biinvariant, the function cp |h(oo)> f ne restriction of to the 
subgroup H(oo) C G, is a 6^(00) -invariant positive definite normalized function on 
H(oo). It follows that (p \h(oo) coincides with the Fourier transform (4.1) of the 
C/(oo)-invariant probability Borel measure M. 

Under the correspondence (T, £) <-> M, ergodicity of M is equivalent to irre- 
ducibility of T. Note also that for an irreducible spherical representation T, the 
vector £ is unique (within a scalar multiple), so that the function <p is an invariant 
of T. 

Thus, irreducible spherical representations of the group G = U(oo) x H(oo) are 
parametrized by ergodic measures on H. For more details about representations of 
the group G, see [012], [Pi2]. 

The graph of spectra. Recall that by Sjv we denoted the subset of M. N formed 
by vectors A with weakly decreasing coordinates. For [i G §jv-i and A G SW we 
write fj, -< A if the coordinates of A and \x interlace: 

Ai > m > A 2 > • • • > Aat_i > hn-x > X N . 

We set 

f EI iv>i-V>j)l 11 (Afc-Aj), if^^A, 

q N - ltN (/JL,X) = < l<i<i<"-l l<k<l<N 

\ 0, otherwise. 
Note that for any A G §tv 



I qN-i,N(fJ>, tydfJ, = 1, dfj, = dfxi . . .dfj, N -! 

Sjv-i 
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Let M be an arbitrary £7(oo)-invariant probability Borel measures and Pn be 
the radial part of the measure $n(M) (this is a probability measure on Sjv). Then 
the measures Pi, P%, . . . satisfy the following consistency relation: 

/ qN-i^d-i, A)Pjv(rfA) = the density of Pn-i at \i. 
Js N 

Conversely, if a sequence {Pn} of probability measures satisfies the above consis- 
tency relation for each pair of adjacent indices then this sequence comes from a 
certain measure M. 

Introduce the set T formed by all infinite sequences 

r=(r (1) ^(^...), r^GS w . 

Consider the probability measures P on T with the following property: for each iV = 
2, 3, ... , the probability that t^ n ~ x ' lies in an infinitesimal region d\i about a point 
£ §at_i conditional that = A, is qN-i,N(l^^ Xjdji. Any such measure P is 
uniquely determined by a sequence {Pn} satisfying the consistency relations. Thus, 
the measures P bijectively correspond to U (oo) -invariant probability measures M 
on H. 

We call the collection of sets {Sn} together with the functions qN-i,N(fi>, 
the graph of spectra. This term was suggested by Sergei Kerov. According to the 
philosophy of [VK] we call the functions qN-i,N(^, A) the cotransition functions of 
the graph of spectra. Here the term "graph" should not be understood literally, it 
only hints at a similarity with some "branching graphs" like the Young graph [VK] 
or the Gelfand-Tsetlin graph [BO]. For instance, the set T is an analogue of the 
set of paths in a branching graph. It can be shown that the graph of spectra can 
be obtained from the Gelfand-Tsetlin graph via a scaling limit procedure. 

Projective limit of the spaces U(N). There exist projections (not group ho- 
momorphisms!) U(N) — > U(N — 1) which correspond, via the Cayley transform, 
to the projections H(N) — > H(N — 1). This allows one to form the projective limit 
space il = \im.U(N). The space il admits a natural two-sided action of the group 
U(oo). The space H is embedded into il, and the measures mS s > are transferred to 
il via this embedding. The resulting measures on il are quasiinvariant with respect 
to the two-sided action of U(oo). This makes it possible to construct for the group 
U(oo) analogs of the biregular representation. See [Ner2], [015] for more detail. 

Analogy with the infinite symmetric group and the Poisson— Dirichlet 
distributions. The construction of the space il mentioned above is parallel to the 
construction of the space hmfffn) of virtual permutations, see [KOV]. Here S(n) 
denotes the symmetric group of degree n. The family of theHua-Pickrell measures 
should be viewed as a counterpart of a family {[it}t>o of probability measures on the 
space of virtual permutations, see [KOV] . The Hua-Pickrell measures play the same 
role in harmonic analysis on the group U(oo) as the measures fi t do in harmonic 
analysis on the infinite symmetric group S(oo). The decomposition of the measures 
on ergodic components is described by the Poisson-Dirichlet distributions. These 
are remarkable probability measures on an infinite-dimensional simplex (see [Kin]), 
which were studied by many authors. Thus, the spectral measures 

pis) 

may be 

viewed as counterparts of the Poisson-Dirichlet distributions. 
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Other examples of group actions. The action of the group U(oo) on the space 
H examined in the present paper is connected with a particular series of flat sym- 
metric spaces {G(N)/U(N) = iy(iV)}jv=i,2,... which in turn is related to a series of 
compact symmetric spaces: we mean the spaces U (N) with the action of the groups 
U(N) x U(N). There exist in all 10 infinite series of compact symmetric spaces and 
related flat spaces. With each such series, one can associate an infinite-dimensional 
group action on a space of infinite matrices (see, e.g., [Pi2]) and a family of 'Hua- 
Pickrell measures' on that space depending on a real or complex parameter (see 
[Ner2]). We expect that the results of the present paper can be carried over to this 
more general context. 



Let 97t be the set of U (oo) -invariant probability Borel measures on H. We equip 
97t with the Borel structure generated by the functions of the form M i— > (F, M), 
where M ranges over 97t and F is an arbitrary bounded Borel function on H. 

Let the symbol ex(. . . ) denote the set of extreme points of a convex set. Recall 
that elements of ex 971 are called ergodic measures. 

Theorem 9.1. (i) ex 971 is a Borel subset in 97T. 

(ii) For any M e 971 there exists a probability Borel measure P on ex 97t repre- 
senting M , i.e., 



for any bounded Borel function F on H . 
(Hi) The measure P is unique. 

There exist different ways to prove such results, in particular: 

(i) Representation-theoretic techniques. 

(ii) Dynkin's theorem about boundaries of general Markov processes, see [Dyn] 
and the references therein. 

(iii) Choquet's theorem about existence and uniqueness of barycentric decompo- 
sition in compact metrizable convex sets which are 'Choquet simplices', see [Ph]. 

In the first way, we reduce the problem to that of decomposing a spherical 
representation of the Cartan motion group G (see §8 above). Here we must adapt 
the classical desintegration theory for representations of locally compact groups and 
C*-algebras (see [Dix]) to groups which are not locally compact but are inductive 
limits of locally compact groups (see [Oil, §3.6]). A crucial fact is that (G, U{oo)) 
is a Gelfand pair in the sense of [014, §6]. 

In the second way, one should use the graph of spectra (see §8) to reduce Theorem 
9.1 to Dynkin's theorem. 

Below we shall follow the third way. 

Proposition 9.2 (Choquet's theorems). Let % be a convex subset of a locally 
convex topological vector space E. Assume that 21 is compact and metrizable. 

(i) ex 21 is a Borel subset of "ft* (more precisely, a G$ subset). 

(ii) For any a G 21 there exists a probability Borel measure P on ex 21 representing 
a, i.e., 



9. Appendix: existence and uniqueness of 
decomposition on ergodic components 





(9.1) 
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(9.2) 



for any continuous linear functional f on E. 

(Hi) The measure P is unique if and only if the cone spanned by "Hi is a lattice. 

Proof. Claim (i) is an elementary fact, see [Ph, Prop. 1.3]. Claims (ii) and (iii) are 
Choquet's theorems, see [Ph, sections 3 and 9]. □ 

We need one more general result. 

Proposition 9.3. For any group action on a Borel space, the cone of finite Borel 
measures is a lattice. 

Proof. See [Ph, section 10]. □ 

By Proposition 9.3, the set 97t satisfies the lattice condition, from the last claim 
of Choquet's theorem. However, there is no apparent way to make 97t a compact 
space, which is the major difficulty to apply Choquet's theorem. We surmount it 
by embedding 971 into a larger convex set to which Choquet's theorem is applicable. 
Here we use an idea borrowed from the proof of Theorem 22.10 in [013] (see also 
section 6 in [OkOl]). 

Proof of Theorem 9.1. For N = 1, 2, . . . let 971^ denote the set of £/"(iV)-invariant 
probability Borel measures on H(N) and let 97t/v be the larger set formed by U(N)- 
invariant finite Borel measures of total mass less or equal to 1. 

Further, let Co(H(N)) be the Banach space of continuous functions on H(N) 
vanishing at infinity, and let En denote its dual space equipped with the weak star 
topology. Using the natural pairing between functions from Cq(H(N)) and finite 
measures, we embed 97t/v into E N . Note that WIn is a compact metrizable space 
with respect to the topology of E N . 

For N = 2,3... let 9 N -i,n denote the projection H(N) -> H(N - 1) which 
consists in removing the iVth row and column from a N x N matrix. This projection 
sends DJIn to 97t/v-i and also sends 97Tat to WIn-i- Moreover, 971 coincides with 
the projective limit space |im 97t;v. 

Note that the map 6n-i,n '■ 971^ — > 9Jliv— l is not continuous. The reason is 
that the projection H(N) — > H(N — 1) is not a proper map. (To illustrate this 
phenomenon, consider the projection of the plane 1R 2 onto its first coordinate axis. 
Take the Dirac measure at a point on the second coordinate axis and move the 
point to infinity. Then the measure will weakly converge to the zero measure, while 
its projection will remain fixed.) 

However, the map 0n-i,n '■ 9JIn — > 971at_i possesses a weaker property: it is 
semicontinuous from below. (This property does not rely on the specific character 
of the projection H(N) — > H(N — 1), it holds for any continuous map between 
locally compact spaces.) This implies that for any N = 2, 3, . . . the set 

A N - hN = {(Mjv_i, M N ) e 97tjv-i x m N | M N _! > 6 N - hN (M N )} (9.3) 
is closed. 

It is convenient to allow the index iV in (9.3) take the value {1}. To this end 
we define H(0) as a one-point set. Then o ,i projects H(l) into a single point, 
the vector space E is identified with R, 97to is the interval [0, 1] e E , and 97to is 
identified with 1. 

Next, we take as 21 the subset of Eq x E\ x . . . formed by infinite sequences 
a = (M , Mi, ... ) such that M = 1, M N e Tl N for N = 1,2,..., and for any 
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N = 1,2,..., the pair (M N _ ljN , M N ) belongs to the set A^-i,n defined in (9.1). 
We remark that 21 is a convex compact metrizable set. 

For any N = 0, 1, 2, . . . we define an embedding i : 971 at — > 21 as follows: 

DJl N 3 M ^ a= (M , Mi, ... , M^v, 0, 0, . . . ), 
M N = M, Mi_! = fli-i.iCA/i), i = JV,...,l. 

We also consider the embedding t : 97T — > 21 which comes from the identification of 
97T with limmtAT. 

Now, we make the following crucial observation: 

(*) Any element a G 21 can be written as a convex combination of certain elements 
a at G t(9Jt./v) element G t(97t). Moreover, this representation is unique. 

By Proposition 9.3, for any N, the cone in E N spanned by DJIn is a lattice, and 
the same is also true for 97T. Together with (*), this implies that the cone generated 
by 21 is a lattice. Thus, the set 21 satisfies all the assumptions of Choquet's theorem. 
Applying this theorem, we get that any point a G 21 is uniquely represented by a 
probability measure P on ex 21. 

On the other hand, (*) implies the following fact: 

(**) ex 21 is the disjoint union of the sets 6(ex97t), t(ex3Jlo), t(ex9Jti), .... 

Since ex 21 is a Borel set by Choquet's theorem, and since all the sets 6(ex97t7v) 
are evidently Borel sets, we conclude from (**) that 6(ex97t) C 21 is a Borel set. 

Next, we note that the Borel structure on 97t coming from its embedding to 
21 coincides with its initial Borel structure. Indeed, both structures are defined 
by functions on 97T of the form M i— > (F, M) , the only difference consists in the 
choice of a class {F} of functions on the space H. In the latter case, F may be an 
arbitrary bounded Borel function, while in the former case F belongs to the smaller 

class of cylindrical functions of the form Go9 N with G G Cq{H{N)), N = 1, 2, 

However, both classes clearly generate the same Borel structure. 

This proves claim (i) of Theorem 9.1. 

Further, it follows from (**) and the definition of the set 21 that if a G 971 then its 
representing measure P is concentrated on t(ex9JT) C ex 21. Comparing (9.1) and 
(9.2) we get that (9.1) holds for any cylindrical function of the form F = G o On 
with G G Cq(H(N)). But then it also holds for any bounded Borel function on H, 
as required. □ 

Recall that we have an explicit description of the set ex 971: it is parametrized 
by the space O (Proposition 4.1). The next claim, together with Theorem 9.1, is 
used in Proposition 4.4 above: 

Proposition 9.4. The 'abstract' Borel structure on ex97t, which comes from the 
standard Borel structures on 97t, coincides with the 'concrete ' Borel structure, which 
comes from the natural Borel structure on O via the bisection ex97T <-> O. 

Proof. Let us show that for any bounded Borel function /, the expression (/, M w ) 
is a Borel function in uj G O. Indeed, it suffices to check this claim for functions 
/ of the form f(X) = e i ^( Ax ) , where A is an arbitrary fixed matrix from H(oo). 
Further, without loss of generality we may assume that A is a diagonal matrix, and 
then the claim follows from Proposition 4.1. 

Consider the correspondence ex97T <-> O provided by Proposition 4.1. We have 
just proved that Q — > ex 971 is a Borel map. Since both O and ex 971 are standard 
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Borel spaces, we may apply a general result (see [Ma, Theorem 3.2]) to conclude 
that our correspondence is an isomorphism of Borel spaces. □ 
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